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Abstract 

We present exact analytic results for a new version of the Minority 
Game (MG) in which strategy performance is recorded over a finite time 
horizon. The dynamics of this Time Horizon Minority Game (THMG) ex- 
hibit many distinct features from the MG and depend strongly on whether 
the participants are fed real, or random, history strings. The THMG equa- 
tions are equivalent to a Markov Chain, and yield exact analytic results 
for the volatility given a specific realization for the quenched strategy 
disorder. 



1 Introduction 

Agent-based models of complex adaptive systems are attracting significant in- 
terest across many disciplines [Q. Typically each agent has access to a limited set 
of recent global outcomes of the system; she then combines this information with 
her limited strategy set chosen randomly at the start of the game (i.e. quenched 
disorder) in order to decide an action at a given timestep. These decisions by 
the N agents feed back to generate the fluctuations in the system's output. The 
Minority Game (MG) introduced by Challet and Zhang || offers possibly the 
simplest paradigm for such a complex, adaptive system and has therefore been 
the subject of intense research activity Most studies of the MG have 

focussed on a calculation of both time and configuration (i.e. quenched disor- 
der) averaged quantities, in particular the 'volatility' a where a is the standard 
deviation of the fluctuations. Our own work has shown that the variations of 
this averaged cr with memory size m can be quantitatively explained in terms 
of 'crowd-anticrowd' collective behavior ^. This crowd-anticrowd theory, 
which implicitly assumes both time-averaging and configuration-averaging, is 
simple and intuitive yet it yields useful analytic expressions ^. In terms of 
more detailed microscopic theories, two complementary spin-glass approaches 
have been shown to be remarkably powerfully, 

In this paper, we wish to focus on the dynamics of the multi-agent game for 
a given realization of the quenched disorder of initially picked strategies. We 
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present exact analytic results for a finite time horizon version of the Minority 
Game, the Time Horizon Minority Game (THMG), in which strategy perfor- 
mance is only recorded over the previous r timesteps. This seemingly trivial 
modification of the basic MG yields a dynamical system with surprisingly rich 
dynamics. These dynamics depend strongly on whether the participants are fed 
real (as opposed to random) history strings, and on the nature of the quenched 
disorder corresponding to initial conditions. We present a set of equations de- 
scribing the THMG - these equations are equivalent to a Markov Chain. This 
Markov Chain is used to generate accurate analytic results for the resulting 
volatility in the THMG. Throughout the paper, similarities and differences be- 
tween the THMG and MG are pointed out where appropriate. Section 2 provides 
a brief introduction to the MG and provides exact analytic expressions for the 
volatility cr for a given configuration of quenched disorder. Section 3 discusses 
the THMG and provides corresponding formulae for this game. Section 4 com- 
pares the analytic and numerical results for the THMG. Section 5 provides the 
conclusion. 

2 The basic Minority Game (MG) 

The MG |] comprises an odd number of agents N (e.g. traders or drivers) 
choosing repeatedly between option (e.g. buy or choose route 0) and option 1 
(e.g. sell or choose route 1). The winners are those in the minority group; e.g. 
sellers win if there is an excess of buyers, drivers choosing route encounter 
less traffic if most other drivers choose route 1. The outcome at each timestep 
represents the winning decision, or 1. A common bit-string of the m most 
recent outcomes is made available to the agents at each timestep The 
agents randomly pick s strategies at the beginning of the game, with repetitions 
allowed (quenched disorder). Each strategy is a bit-string of length 2™ which 
predicts the next outcome for each of the 2™ possible histories. After each turn, 
the agent assigns one (virtual) point to each of her strategies which would have 
predicted the correct outcome, and penalizes a strategy by one (virtual) point 
if it incorrectly predicts the outcome. At each turn of the game, the agent uses 
the most successful strategy, i.e. the one with the most virtual points, among 
her s strategies. 

The number of agents holding a particular combination of strategies can 
be written a,s a D x D x . . . {s terms) dimensional tensor fl, where D is the 
total number of available strategies. For s = 2, this is simply a D x D matrix 
where the entry represents the number of agents who picked strategy i 

and then j. The strategy labels are given by the decimal representation of 
the strategy plus unity, for example the strategy 0101 for to = 2 has strategy 
label 5-1-1=6. This quenched disorder fl is fixed at the beginning of the game 
and can be written using the full or reduced strategy spaces The value of 
describes the prediction of strategy R given the history /i, where fi is 
the decimal number corresponding to the TO-bit binary history string. Hence 

= — 1 denotes a prediction of choice '0' while a'^ — 1 denotes a prediction 
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of choice '1'). The approach of our (time and configuration-averaged) crowd- 
anticrowd theory was to partition the A'^ agents into g groups in such a way that 
the groups themselves were uncorrelated. This was achieved by considering the 
reduced strategy space, which produces essentiahy identical results to the full 
strategy space for the volatility. Specifically, each group g contains a crowd of rig 
agents using highly correlated strategies, and an anticrowd of agents using 
strategies which are highly anti-correlated to the crowd. This leaves an effective 
super-agent of size Ug = — representing each group. Since the strong 
correlations have now been removed from the problem, the resulting groups are 
essentially uncorrelated and can be considered as executing random walks with 
respect to each other in terms of their decisions. As shown in Refs. ^, 
summing the resulting variances yields excellent agreement with the numerical 
values for the volatility ((cr))n, where {{■ ■ denotes averaging over all initial 
configurations of quenched disorder {^}. 

Here we are interested instead in the detailed dynamics of the game for a 
given choice of initial quenched disorder ^l, hence we follow a more microscopic 
approach. This is particularly relevant if the intended application of such games 
is to understand financial markets, since such markets should each correspond 
to just one realization of the game given an initial fi. Hence we imagine that 
a particular has already been chosen. Since the game involves a coin-toss to 
break ties in strategy scores, this stochasticity also means that different runs for 
a given will also differ - we return to this point below. The number of traders 
making decision 1 (the 'instantaneous crowd') minus the number of traders 
making decision (the 'instantaneous anticrowd') defines the net 'attendance' 
A[t] at a given timestep t of the game. This attendance A[t] is made up of two 
groups of traders at any one timestep: there are Aolt] traders who act in a 
'decided' way, i.e. they do not require the toss of a coin to decide which choice 
to make - this is because they have one strategy that is better than their others, 
or because their highest-scoring strategies are tied but give the same response 
as each other to the history fit at that turn of the game. In addition, there 
are Au[t] traders who act in an 'undecided' way, i.e. they require the toss of a 
coin to decide which choice to make - this is because they have two (or more) 
highest-scoring tied strategies and these give different responses to the history 
fit at that turn of the game. Hence the outcome at timestep t is given by 

A[t]^AD[t] + Au[t] . (1) 

The state of the game at the beginning of timestep t depends on the strategy 
score vector and a history fit at that moment. Henceforth we will drop 
the variable t from the notation, but note that it remains an implicit variable 
through the time-dependence of s and fi. We also focus on s = 2 strategies per 
agent, although the formalism can be generalized in a straightforward way. At 
timestep t, Ajj is given exactly by 

AD{s,fi)= «fl(l + Sgn[sK-s^/])i^,,, (2) 
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where the symmetrized matrix _4|_ = ^{^^+^^^) with Q representing the quenched 
disorder. The element fl„ „, gives the number of agents picking strategy R and 
then R'. The number of undecided traders Nu is given exactly by 

r,r'=i 

and hence the attendance of undecided traders Au is distributed binomially in 
the following way: 

Au{s,fi)= 2Bm[Nu{s,^i),^]-Nu{s,|^) (4) 

where the term 'Bin' denotes a binomial distribution with Nu{s,ii) trials and 
probability 1/2. 

The so-called 'volatility' is used in finance to describe some statistical char- 
acteristic of the fluctuations in the market. It does not have a unique definition 
in the finance literature but is typically taken as some form of 'root-mean- 
square' fluctuation - however this definition leaves open the question of which 
mean should be computed. In the present context, it makes sense to define the 
volatility in terms of the time-average of a particular realization k of the ran- 
dom process A[t], given an initial quenched disorder fl. As mentioned above, 
our crowd-anticrowd theory was limited to consideration of a time-avcragcd 
volatility {{cr))n which had also been averaged over all configurations of initial 
quenched disorder {O}. The present work goes beyond this limitation to consid- 
eration of a particular choice of quenched disorder Q. Consider any stochastic 
process z{t) produced by a particular realization k of the game, given an initial 
quenched disorder fl. This quantity z{t) could represent the attendance A[t] at 
timestep t, or any time-dependent quantity derived from it such as the mean 
attendance at timestep t calculated over the past n timesteps, or the volatility 
defined as the root-mean-square attendance over the past n timesteps. The 
finite time average of the fc'th realization of this process is given by 

1 rt+T/2 

i^'^mT = - / '•'^z{t')dt' . (5) 

Jt-T/2 

If T is finite, then [^'^'>z{t)]T is itself a random process. In real financial markets, 
the volatility defined by such a finite-time average docs indeed fluctuate pro- 
ducing 'volatility clustering'. Here we instead wish to focus on the time-average 
which is defined in the T ^ oo limit: 

Wi = LimT^^ i r^^^ ^''h{t')dt' , (6) 

^ Jt-T/2 

which no longer depends on t or T but in general does depend on the particular 
realization k of the ensemble that wc have chosen in addition to the dependence 
on the initial quenched disorder il. In the absence of stochastic tie-breaks. 
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the attendance A[t] would be deterministic hence producing a deterministic 
Minority Game for a given initial quenched disorder However in the 

presence of stochastic tie-breaks, which is the case of interest here, the game 
should self-average in the following sense: for a given quenched disorder fi, 
the time-average of A[t] or any of its higher order correlation functions (e.g. 
volatility) for a given realization k should be equivalent to the ensemble average 
value taken over all realizations fc at a given time t. We stress that this discussion 
is for one particular (fixed ) quenched disorder - we are not averaging over 
this quenched disorder. Henceforth we will therefore assume that this ergodic 
principle holds given a particular O, i.e. we assume that the time-average and 
ensemble-average of both the attendance A[t] and the volatility are equivalent 
for fixed quenched disorder U. We will denote this average attendance as A 
and the associated average volatility as cr, noting that both have an implicit 
dependence on the initial quenched disorder fl. Hence for a given fi, the square 
of the volatility is given exactly by the expectation value of the mean-square 
attendance: 



Y,iA-AfP{A) 



(7) 



where P{A) is the probability that the attendance is given by A. From Eq. 
(1) the attendance A = Ad{s, ij) + Aj/(s, /x,a;) where we have included the 
stochastic variable x to denote the coin-toss process. Because this coin-toss 
process is unbiased, we have Au{s, ^, x) = and hence A = Ad(s, /i). The 
probability P{A) is exactly equivalent to the probability of obtaining a given s, 
IJ, and X. Since x is an independent variable, we have 



P{A) = P{p\s)P{s)P{x) 



(8) 



with P{x) given by the binomial expression ^" Cx{h)'^" ■ 



. Here P{s_) is the 
probability that the strategy score vector is s, while P(/i | s) is the probability 
that the game is in a state where the history is /x given that the strategy score 
vector is s. Hence Eq. (7) can be rewritten exactly as 



r r 

E E E 

{s} '-{^} L^=0 



''"Cxil)''''iAD + 2x 



Nu - Af 



P{l^ I s) 



(9) 



with the mean attendance being given exactly by 



A 



E E 



Ad P{y^ I s) 



Pis) 



(10) 



where in Eqs. (9) and (10) Ad = Ad{s,ii) and Nu = Nu{s,n). The difficulty 
in evaluating this expression for the volatility in the MG, for a given quenched 
disorder Vi, now lies in the complexity of P(s) and P(/i | s). As an example of a 
specific realization of the initial quenched disorder, we shall take throughout 
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this paper to be the following randomly-chosen matrix in the reduced strategy 
space: 
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(11) 



Figure 1 shows the resulting P(s) for = 101, m = 2, s = 2 and fl as 
shown above. The strategy scores themselves are written out explicitly for the 
dominant score vectors. As can be seen, the probability distribution P{s) is 
uneven and has non-trivial structure. 



3 Time Horizon Minority Game (THMG) 

In the basic MG, strategy scores are kept since the beginning of the game. One 
might ask whether this is realistic in a 'real-world' situation, given the finite 
time-horizon under which most 'agents' (e.g. traders) tend to operate. Hence 
we will make a small modification to this rule - we introduce the Time Horizon 
Minority Game (THMG) in which strategy scores are only kept over the last 
r turns of the game. Hence agents (e.g. traders) arc limited to assessing their 
strategies' performance over the last r turns of the game, in addition to the 
basic MG rule of viewing just the last m steps of the history. We focus on the 
low m regime because of the richer dynamics, however our formalism applies for 
all m. 

Figure 2 shows numerical results for the variation in volatility as a function 

of T, given different realizations of the initial quenched disorder fi. Results are 
shown for m = 3 using the full strategy space, and for both real and random 
histories of the game. For real histories it can be seen that the volatility is 
essentially periodic in 2.2™. This value corresponds to the number of different 
paths in a De Bruijn graph linking all P = 2™ histories. Such a graph is 
necessarily Eulerian since all the vertex-degrees of a De Bruijn graph are even. 
Games that differ in r by multiples of 2.2™ show similar dynamics for t > t. 
The dynamics of the THMG for t < t are that of the basic MG, as can be seen 
in Figs. 3a and 3b for small t. 

The peaks in Fig. 2 which arise at t = 2.2'"A — 1 for real histories, where 
A > 1 and is an integer, correspond to realizations of the game that are purely 
deterministic. If the game performs a path around the de Bruijn graph that is 
of a length r and satisfies the condition that all edges have been visited equally 
during the course of this path, then s and ^ at the start of the cycle are identical 
to s and /z at the end of the cycle, i.e. Ascyde = and Aiicycie = 0. Note that 
even for large A this is very likely to happen due to the nature of the minority 
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game in the efficient regime [Q. In the THMG it is observed to occur very 
soon after t becomes larger than r. Once this type of path occurs for integer 
A, the game evolves such that sf^ is equal to at any subsequent time-step 
of the game. Note that for integer A the strategies are scored for one time-step 
less than the period of this special cycle; this fact together with Ascyde = 
and A^cycie = imply that = zLaf^. When s'^ = ±a'^, we are left with the 
unique situation where all tied strategies that have a particular score at history 
/X give the same game decision, i.e. -1-1 or —1. When this happens there are 
no longer any traders that have tied strategies telling them to make opposing 
decisions. None of the game dynamics for this turn of the game are therefore 
decided by the tossing of coins - this turn is hence purely deterministic. Once 
the game has found such a deterministic state, it never leaves it and the game 
henceforth evolves such that — ±a^. Figure 3a shows the finite time-average 
standard deviation (over 100 turns) of the attendance, together with the actual 
number of traders making a given decision as a function of time. The case shown 
corresponds to A = 100 and hence r = 1599. For time-steps to 1599 the system 
is equivalent to that of the basic MG, whereas from t = 1600 onwards the effect 
of the time horizon on strategy scores becomes apparent. The system only takes 
about 40 time-steps to become locked into the deterministic state described 
above. We have observed at low m and for several randomly selected fl, that 
once t becomes larger than t then the game rapidly finds the deterministic state 
described above. The game dynamics hence become deterministic and periodic 
with period t + 1. It is possible to construct specially chosen matrices such 
that the above special cycle is not found during a run of the corresponding game, 
however we are here interested in characterising the dynamics for a 'typical' (i.e. 
randomly chosen) fi. Figure 3b shows the corresponding results for r = 1600. 
We stress that the THMG with random histories has very different dynamics as 
can be seen in Fig. 2. 

We now present an analytic description of the THMG. Consider t + 1 con- 
secutive histories in the game and call this a //-path, denoted as fipath- We define 
G as the matrix telling us which transitions between histories are allowed in the 
game - the matrix G is the P x P 'adjacency' matrix of a de Bruijn graph of 
order m. The element ^ has value 1 if history ly can follow history /i in the 
game, but has value if the transition is disallowed. The adjacency matrix is 
hence given by 

^ = d{2n%P - I/) + S{2fi%P +1-1/) (12) 

where A%B is the remainder when A is divided by B. Here /i and v denote the 
nodes (i.e. histories) in the de Bruijn graph where /i, = 0, 1, ... The matrix G 
quantifies which paths around history space are allowed and hence we can write 
down a rule for determining which Upath transitions are permitted in the game. 
^et Upathit-l) = fJ-t-T-i fJ-t-T ■•■Mt-i- Whether fipathit-1) actually arises 
in the game, and whether the transition to Upathit) — fJ't-r l^^t-r+i — > ■■■^^t 
is allowed, depends on whether all the transitions are allowed between histories 
in fipathit — 1) and the corresponding history in fj.path{t)- Figure 4 shows an 
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example of the allowed transitions between /x-paths for m = 2, r = 2. Let us 
define a scalar quantity F given by 



r = TTG . (13) 

i=0 

The transition between i-J.pai.h{t ^ 1) ^md i-ipaih{t) is allowed if F = 1, but is 
disallowed if F = 0. The increment in score vector when passing from one 
history at time-step t — 1 to the next history at time-step t is given by 



= (2a^'-^ - l)(2(Mt%2) - 1) (14) 



It follows that 



—fJ-path 



E^M.-.-.-M*-. • (15) 



i=0 



We can evaluate the exact number of decided and undecided traders for a 
given ^pathi and we can also identity which ^path are allowed in the game; hence 
we can find the transition matrix giving the probability that a particular Upath 
at an arbitrary timestep evolves to the next allowed jipath with final history Ht. 
This transition matrix is given as follows: 



Nu 

T = V 

=A»patfe(t-l)>^'pati,(t) ^ 

x=0 



+ (2(Mt%2) - 1) 



Sgn(AD +2x- Nu) 

(16) 



where Ad = Aodj-pathit - 1)) = AD{s^^^^^(^t-i)^ f^t-i) and Nu = Nu{fipath{t - 
1)) = 7V[/(s^^^^^(t_i),^t_i). The size of Z is given hy <p = 2(™+^). For the 
basic MG cj) would grow indefinitely with time t, however for the THMG it 
is of fixed size. Having obtained this transition matrix for the THMG then 
allows us to calculate various macroscopic quantities, in particular PiUpath)- 
The vector P{npath) satisfies P{npath) = P{lJ'path)T_ which is the transpose of 
an eigenvector-eigenvalue equation. The vector P{Hpath) is also a stationary 
distribution of the Markov Chain: 

p{^ipath) = [r^lTru.,u ■ (17) 

The expression given for P{^J-path) represents an average over all games with 
different /x-paths defining the initial conditions of the game. This is achieved by 
taking an average over all (f> rows of the matrix T°°. This method assumes that, 
for all possible states in the set {fipath}, if a state is visited then the state can be 
re-visited during a run of the game. We note that if there are closed irreducible 
subsets in the set of /x-paths {^path} which are visited during the time evolution 
of the THMG, the game can then lock into a deterministic state. This situation 
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of deterministic states arises for r = 2.2'"A — 1 as discussed earlier. In this 
case, the present method for calculating P{npath) could be improved to account 
more fully for the deterministic dynamics since in general the system is not 
ergodic Wc do not consider such a calculation here, but note that the values of 
a obtained using the present method may still be very accurate (see later Fig. 
6 for T = 7 for example). 

Figure 5a shows the measured P{^ipaih) for N = 101, m = 2, s = 2, as 
in Eq. (11) and r = 2. Figure 5b shows the corresponding calculated P{iJ,path) 
using Eq. (13). The agreement is excellent, demonstrating that our expression 
for P{fipath) is exact. 



4 Results 

We now show how to calculate the volatility of the THMG exactly using Eq. 
(9). Without loss of generality, we replace both P{s) and P(/z | s) by the 
probability P{^ipath) that the game has just passed through one particular jipath 
at a timestep t. This reduces the problem of calculating the volatility a in the 
THMG to that of studying a Markov Chain whose states are given by the set 
{iJ'path}- Note that whilst the THMG is homogeneous, the basic MG is not 
since the size of the set {fipath} grows as t increases. Replacing both P(s) and 
P(/U I s) by the probability P{^ipath) in Eq. (9), we have an equivalent exact 
expression for a given by : 



x=0 



PifJ-path) 



(18) 



In order to calculate Ad and Nu exactly for a given iJ,path, the score vector 
to be used is that which would be obtained if the game went through a path 
of histories corresponding to fipath as in Eq. (15); the history to be used is 
the last history in the path fipath- Denoting this last history as /x, we have 
Ad = AD{Hpath) = Aois^^^^^, ^i) and Nu = Nuinpath) = Nu{s^^^^^, n). We 
note that the exact analytic expression given for a in Eq. (18) applies to the 
limiting case where the number of realizations used to numerically determine a 
tends to infinity (i.e. ensemble average). We also note that using the formalism 
described, we could alternatively have obtained a finite time-average volatility 
cr between t = ti and t = t2 given a specific Upath &t t = ti. 

Using Eq. (17) in Eq. (18), together with Eqs. (2), (3) and (10), we 
obtain analytic values for a in the THMG given the initial quenched disorder 
ri. Figure 6 shows a comparison between the analytic values for the volatility a 
and the numerical values taken from the game as a function of the time-horizon 
T. Here N = 101, m = 2, s = 2, and O is given in Eq. (11). We only show 
T = 1 ^ 2.2"* + 1, i.e. A = 1; however similar results can also be obtained 
for A > 1. The agreement is excellent, with the numerical and analytic lines 
essentially coincident. This demonstrates the power and accuracy of the present 
Markov Chain formalism as developed for the THMG. 
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5 Conclusion 



In summary, we have introduced and studied a finite time horizon version of 
the Minority Game (THMG). We have presented exact analytic expressions for 
the volatility in both the THMG and the basic MG, for a given configuration of 
initial quenched disorder H.. We have presented an analytic theory to describe 
the dynamics of the THMG by obtaining an analytic expression for the transi- 
tion matrix in terms of the set {/-ipath}- As an example of what can be achieved 
analytically, we obtained excellent agreement between analytic and numerical 
values for the THMG volatility, given knowledge of the initial quenched disor- 
der fi. Finally we would like to stress that our theoretical approach and results 
avoid having to keep track of the labels of individual agents - our results are ob- 
tained for a specific initial quenched disorder f2, however this 51 describes many 
possible arrangements of individual agents. In this sense, defines a macrostate 
for which there are many possible microstates corresponding to different initial 
strategy choices by the A'' individual agents. 

We thank Pak Ming Hui for discussions. 
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FIG. 1. The probability of occurrence P{s) of the strategy score vector 
obtained numerically from the Minority Game (MG). Strategy score vectors s 
are listed in an arbritary order along the x-axis. Unless otherwise stated, the 
game parameters in Figs. 1-6 arc as follows: N = 101, m = 2, s = 2 with the 
initial quenched disorder matrix taken from Eq. (11). 

FIG. 2. Standard deviation (volatility) cr as a function of time horizon r 
for the Time Horizon Minority Game (THMG) with m = 3. Results are ob- 
tained using the full strategy space. Numerical data is collected using real his- 
tories (black circles) and random histories (grey circles) with randomly selected 
quenched disorder matrices fl. The lower short-dashed line shows the value of 
the volatility for the basic MG in the high m limit. The upper long-dashed line 
shows the configuration-average volatility (i.e. average over quenched disorder 
J7) for the basic MG with to = 3. 

FIG. 3. The finite time-average standard deviation (average taken over 100 
turns) of the attendance of traders (black line) together with the number of 
traders choosing '1' (grey circles) as a function of time t. (a) A = 100, i.e. 
T = 1599. (b) T = 1600. 

FIG. 4. Schematic diagram showing the allowed transitions between /i-paths 
in the THMG for the following example: fipath{t — 1) = 2— >0— >1 and 
TO = 2,r = 2. 

FIG. 5. (a) Numerical and (b) analytic results for the probability distribution 
P{fJ'path) as a function of Upath- /U-path are listed in order of increasing decimal 
representation along the x-axis. Game parameters are N = 101, to = 2, s = 2, 
f2 as in Eq. (11), and r = 2. 

FIG. 6. Standard deviation (volatility) a for the THMG as a function of 

time horizon r, for a given initial quenched disorder 17. Exact analytic values 
are grey diamonds joined by a thick grey dashed line, numerical values taken 
from the game simulation are black circles joined by a thick black line. These 
lines are essentially coincident thereby demonstrating the excellent agreement 
between the analytic theory and the numerical results. Here N = 101, m = 2, 
s = 2, and O is from Eq. (11). Lower short-dashed line shows the value of the 
volatility for the basic MG in the high to limit. Upper long-dashed line shows 
the configuration-average volatility (i.e. average over quenched disorder fl) for 
the basic MG with to = 2. 
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